Multi-voxel pattern recognition techniques combined with Hidden Markov models can be used to discover the mental states that people go through in performing a task. The combined method identifies both the mental states and how their durations vary with experimental conditions. We apply this method to a task where participants solve novel mathematical problems. We identify four states in the solution of these problems: Encoding, Planning, Solving, and Respond. The method allows us to interpret what participants are doing on individual (...) problem-solving trials. The duration of the planning state varies on a trial-to-trial basis with novelty of the problem. The duration of solution stage similarly varies with the amount of computation needed to produce a solution once a plan is devised. The response stage similarly varies with the complexity of the answer produced. In addition, we identified a number of effects that ran counter to a prior model of the task. Thus, we were able to decompose the overall problem-solving time into estimates of its components and in way that serves to guide theory. (shrink)

This article investigates the potential of fMRI to test assumptions about different components in models of complex cognitive tasks. If the components of a model can be associated with specific brain regions, one can make predictions for the temporal course of the BOLD response in these regions. An event‐locked procedure is described for dealing with temporal variability and bringing model runs and individual data trials into alignment. Statistical methods for testing the model are described that deal with the scan‐to‐scan correlations (...) in the errors of measurement of the BOLD signal. This approach is illustrated using a “sacrificial” ACT‐R model that involves mapping 6 modules onto 6 brain regions in an experiment from Ravizza, Anderson, and Carter (in press) concerned with equation solving. The model's visual encoding predicted the BOLD response in the fusiform gyrus, its controlled retrieval predicted the BOLD response in the lateral inferior prefrontal cortex, and its subgoal setting predicted the BOLD response in the anterior cingulate cortex. On the other hand, its motor programming failed to predict anticipatory activation in the motor cortex, its representational changes failed to predicted the pattern of activity in the posterior parietal cortex, and its procedural component failed to predict an initial spike in caudate. The results illustrate the power of such data to direct the development of a theory of complex problem solving, both at the level of a specific task model as well as at the level of the cognitive architecture. (shrink)

Open‐ended tasks can be decomposed into the three levels of Newell's Cognitive Band: the Unit‐Task level, the Operation level, and the Deliberate‐Act level. We analyzed the video game Co‐op Space Fortress at these levels, reporting both the match of a cognitive model to subject behavior and the use of electroencephalogram (EEG) to track subject cognition. The Unit Task level in this game involves coordinating with a partner to kill a fortress. At this highest level of the Cognitive Band, there is (...) a good match between subject behavior and the model. The EEG signals were also strong enough to track when Unit Tasks succeeded or failed. The intermediate Operation level in this task involves legs of flight to achieve a kill. The EEG signals associated with these operations are much weaker than the signals associated with the Unit Tasks. Still, it was possible to reconstruct subject play with much better than chance success. There were significant differences in the leg behavior of subjects and models. Model behavior did not provide a good basis for interpreting a subject's behavior at this level. At the lowest Deliberate‐Act level, we observed overlapping key actions, which the model did not display. Such overlapping key actions also frustrated efforts to identify EEG signals of motor actions. We conclude that the Unit‐task level is the appropriate level both for understanding open‐ended tasks and for using EEG to track the performance of open‐ended tasks. (shrink)